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The Teacher Practices Observation Becord (TPOE) and 
the Florida Climate and Control System (FLACCS) were reviewed to 
determine their appropriateness for measuring teacher competencies 
defined by teachers in Carroll County , Georgia. The TPOE looks at the 
way the teacher develops subject matter and thinking processes of 
pupils througi the eyes of Dewey's experimentalism. FLACCS records 
teacher attempts to modify the behavior of pupils in the classroom, 
both verbal and nonverbal, scaled from relatively gentle, 
unobstrusive, noncoersive behaviors to ordering and commanding, and 
the use of negative affect in the management of behavior. Following 
the assembly of items into measures for behavioral indicators, by 
observers, these measures were pooled across observers to create a 
single measure for each teacher for each indicator , then indicators 
were pooled tc represent competencies for each teacher for each 
observation instrument, and finally the data were pooled across tl^e 
two instruments, FIACCS and IPO?, to create nine competencies as 
these two instruments reflected the perception of the Carroll County 
teachers. Two primary results emerged: the competencies often formed 
linear relations with the gain measures, but they were about as often 
contrary to expectations as in agreement with them, and the second 
outcome was the tendency cf the competencies to form linear 
relations, but, in contrast, for the empirical-logical composites to 
form complex relations with the pupil gain measures. (BC) 
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Introduction 



The previous paper has identified the source of the competencies defined 
by Carroll County teachers bnsed on intensive discussion of their perceptions 
?^ competencies necessar>' for teachers after review of competencies 
identified by the major competency based programs in the nation. This list 
was then validated against the judgments o|. all teachers in the same county. 

The next step was to identify behaviors to measure these competencies. 
It seemed reasonable to review existing instruments which have had a history 
of developmental work, and to draw from them already existing measures which 
appeared to represent the competencies identified by Carroll County teachers, 
insofar as possible. Such a process would enable the project to start 
materially further along in ihe developmental process , avoid duplication of 
effort, and capitalize on the experience and empirical work of previous 
instrument developers. - 

The two instruments wh;ich will be reported here, as they were involved 
in that process, were the Teacher Practices Observation Record (;tPOR),. developed 
by Brown (1968), and the Florida Climate and Control System (FLACCS) developed 
by Soar, Soar and Ragosta, (1971). TTie TPOR looks at the way the teacher 
develops subject matter and i he thinking process of pupils through the eyes 
of Dewey's experimentalism. It records such information as whether the 
problem is the teacher's or ihe pupils'; whether pupils are actively involved 
in the development of the problem, or whether it comes "prepackaged", whether 
pupils seek materials, or work from narrowly defined sources; whether pupil 
ideas are welcomed in the development of ideas or whether pupils are expected 
to conform to the teacher's ex])ectations and the pattern she has predetermined-,^ 
for the development of the unit; whether the teacher gives immediate"right- 
wrong" feedback; and whether motivation is intrinsic or extrinsic. Tliere is 
a total of 62 such paired items. FLACCS records teacher attempts to modify 
the behavior of pupils in the classroom, both verbal and nonverbal, scaled 
from relatively gentle, unobtrusive^ noncoersive behaviors to ordering and 
commanding, and the use of negative affect in the management of behavior,: 
It also records the response of pupils to these management attempts by the 
teacher, the extent to which pupils themselves assiune responsibility for 
an activity, the kinds of grouping and freedom of movement of pupils in the 
classroom, and the expression of affection in the eight combination of teacher- 
pupil, verbal-nonverbal and positive-negative. 
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Selecting Behaviors to Represent Competencies 

The process of identifying specific beliavioral measures to represent 
teacher competencies presented problems and uncertainties. The competencies 
themselves were written at high levels of inference, but indicators were 
also identified which represented somewhat mure specific behaviors on the 
part of teachers and pupils. It seemed reasonable to expect that the same 
indicator might appear in relation to several cpmpetencies . For example, 
task involvement by the pupil might be an indicator of effective communication 
by the teacher, selection and differentiation of materials, and effective 
classroom management. But when these indicators were used to identify 
specific behavioral measures, considerable overlap from competency to 
competency occurred. In addition to this, there was the problem that both 
competencies and indicators had been written at sufficiently high levels of 
inference that differentiating the meanings of one from another was often 
difficult. As an example of the occurence of the same indicator across 
competencies, pupil task involvement was described in one way or another in 
^ ^h?,^^ competencies; and the relation of competencies to each other is 
reflected in the relation between competency 3, ^'Demonstrates ability to 
communicate effectively with students", and 4, ^'Assists students in using 
a variety of relevant communication techniques . iVliile the focus of each 
competency is clearly different, perhaps beciiuse we know so little in fine 
grained detail about what teacher behavior promotes what pupil growth, 
distinguishing between the competencies at the behavioral level was not 
easily done. Similarly^ competency 1, "Gathers and uses information relating 
to individual differences among students," seems to imply behaviors in 
common with competency 7, "Uses a variety of methods and materials to stimulate 
and promote pupil learning;" and both seem to relate to a degree with 
competency 2, "Organizes" pupils, resources and materials for effective 
instruction." 

After items had been identified to make up behavioral measures of each 
of the indicators, it seemed obligatory to follow recommendations made by 
some of the panelists to assure positive int<.?rrelationships among the items 
making up each indicator (Medley, Soar 5 Soar, 19753 . ^Vhen this was done, 
items which logically belonged in the clustei* making up the indicators were 
sometimes found not to belong together on the basis of their intercorrelation. 
For example, one of the indicators for competency 3 was "Uses a variety of 
methods, verbal and nonverbal, to deliver in.'»tructions . " Empirically, the 
verbal and nonverbal instructions given by teachers were scarcely related, 
and this raises the logical problem of what behavioral measures to assemble 
to represent that indicator. We did pool items representing those behaviors 
on the logic that thi:; was required by the competency as the teachers had 
defined it, feeling that the problem was inherent in the process of developing 
measures based on logical definitions. But in other cases where only an item 
or two failed to relate to the remainder of a cluster of items,. the unrelated 
item was dropped. 

Reliabilities of the indicators were estimated by correlating the data 
of different observers who had observed on different occasions, following 
the recommendations of Medley and Mitzel (1963) and echoed by McGaw, 
Wardrop, and Bunda (1972). 'Hiese were not high by the usual standards for 
reliability, ranging from zero to .75, but most would become significant 
when adjusted by Spearman-Bro\m procea'ure to recognize the later pooling 
which was to be done. 
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Following the assembly of items into measures for behavaoral indicators, 
by observer, these measures were pooled across observers to create a single 
measure for each teacher for each indicator, then indicators were pooled 
to represent competencies for each teacher for each observation instrument, 
and finally the data were pooled across the two instruments, FLACCS and TPOR, 
to create nine competencies as these two instruments reflected the perceptions 
of the Carroll County teacliers. 

Empirical-Logical Composites 

The other measures which were used in the analyses of these data were 
composites of teacher beliavior which were de!;cribed in an earlier report 
(Soar § Soar, 1973}. They were derived partially on a logical basis, but the 
logical analyses were based on a series of earlier factor analyses, study of 
those factors in relation to measures of pupil gain, and subjective reactions 
to observation in classroom through the eyes of these measures. They were 
included in the analysis because they seemed to make distinctions that are not 
commonly made by teachers in the field. In particular, they distinguish teacher 
control of behavior from teacher control of the choice of the Jeaming task, and 
both of these from teacher control of pupil thought. Past correlational data 
indicated that teachers do not tyj^ically make these -distinctions, although a 
few do. Limited data also suggested that th(^ distinction may provide useful 
measures for predicting pupil gain. 

Analysis of Data 

As indicated in the earlier paper, pupil achievement and .self-concept 
data were reduced to adjusted classroom mean post scores covarylng pretest and 
socioeconomic status- 'ilie sample was made up of the largest sets of grade 
levels in which the same tests were used. Twenty- four classrooms were avail- 
able in grades three through eight in which the Iowa Tests of Basic Skills had 
been used, and forty classrooms, grades four through 12 in which the How I Seo 
Myself self-coacept measure was used. 

Five achievement subtests selected to cover a wide range of cognitive 
levels, and five self-concept subscales were used as dependent variables in 
multiple regression analyses in which the independent variables were the compe- 
tencies derived by the Carroll County teachers and, in another analysis, the 
empirical-logical composites, llie process nu^asures wez^e used not only as 
linear variables, but also as product and squared terms to test for nonlinear 
relations and for interactions of the behavior measures with either socioeconomic 
status or giade level (Kerlinger Pedhauziir, 1975J , Since the number of vari- 
ables used in each multiple regression exceeded that v/h i ch would be appn^opriate 
under a conservative use of the method, the data are presented separately for 
a **best** model based on the smaller number of 1 inear relationships, and for 
later pliases of the analysis in which noniin<jar and interaction terms were per- 
mitted to enter. Total amounts of variance ;iccounted for are not reported sLnce 
they are likely to be inflated as a consequence of the number of variables em- 
ployed, and that same effect can be expected to some degree for the individual 
variables. But at the same time, our limited knowledge in this area of research 
and the expense of collecting such data seem to argue for exploring possibilities 
which conservative statistical practice would forbid, recognizing the uncertaint) 
of the results , 



Results 



Results for achievement are presented in Tables 1 and 2, the results 
for self-concapt in Tables 3 and 4. The lists of behavior measures are 
shovm at the bottom of Tables 1 and 2.^ Since the results are reported in 
unconventional fashion in order to present tliem more compactly, a footnote 
at the bottom of Table 3 explains the manner in which the results can bo 
interpreted. 

Although for the sake of brevity, results are sometimes described in 
terms which imply causality, the study is a correlational one, and causal 
conclusions cannot be drawn. t-ciubai 

The results for the teacher derived comj>etencies as they related tn 
pupil achievement gain arc sho.m in Table 1.' Since all of th'e c ^peleLies 

to the growth orpi^ils' ir'r '^'^^^^^^ ^^''^^ ^^-^ ^^^^'"^'^ ^° be'impor :nt 
the lisfof .HanH??^ ^^lationships should be posLtive. Although 

the list of significant linear relationships is encouraging. six of the eight 

dlmcuuJef "li": ''''''''' direction, which presfntf' interpretive ' 
Or.fnizes nuDils relationships are very reasonable- Competency . 

organizes pupils, resources and materials for effective instruction is a 

r^ReacL";-. '° '° ^-^^^i^g g-"^^- Simular?;, Competoncy 

9, Reacts with sensitivity to the-"heeds and feelings of others is a verv 
reasonable measure to relate to growth in arithmetic concepts '-perhl^f 
^^is ^^nH ''""^ difficult and threatening than any other 

Ic pt^^crof^LJirafr^r-"' ''r'r^ ^''''^ °^ ^-^^^^^^ more teacher- 

acceptance ot pupil affect m math classes than in social studies classes * 

Cas he explains i.-nformally , because more students cried theJe). But ?he 
thS relationship of that sanie competency with vocabulary perhaps indicates 
IJlt ^P«"ds considerable ti-,e .in a close, one-to-one ^^coinseU^p" 

ouiiL ^o faHH? r"''"'f sufficiently available as a model to all ' 

pupils to facilitate vocabulary growth. However, the frequency of unexpected ' 
relationships makes interpretation of any of these results doubtful. 

V.I ^iP5^°".°f interactions is difficult, because the contrast is 

Until ^ y. f indicate a behavior which is more facilitative of 

growth at higher grade levels.for example, or less so at lower ,-rade levels 
and either statement should be taken as including the opposite attern as a' 
possibility. At the risk of over simplifyinj,^ , the interactions' with grade level 
indicated that high amounts of: 

C 3, Demonstrates ability to communicate effectively with students, was 
associated witii greater achievement gains at the lower {grades for' voca- 
bulary and arithmetic problems. 

C 1, Gathers and uses Information relating to individual differences 
among students, ,;as associated with greater achievement gains at the 
higher grade levels. 

The latter finding seems reasonable in the light of the increased range of 
achievement found at the liigher grade levels. ■ 



The results for the relationships between pupil achievement, and the 
empirical-logical composites are shown in TabLe 2.~ The fact of the few linear 
relations and the many complex relations is perplexing, particularly in com- 
parison with the teacher derived competencies. 

The negative relation of E 7, Closeness of teacher attention to pupils, with 
vocabulaiy growth parallels the findings for C 9 with a similar name, despite 
the fact that only one item was common to the two measures. The negative relatioi 
between E 3, Harsh control, and pupil reading growth follows expectations. 

Results for- the interactions showed that greater gain for low SES pupils was 
associated with smaller amounts of: 

E 2, Teacher control, general and 

E 3 , Harsh con tro 1 , y^-^ 

and was associated with greater ainounts of: 

E 1, Gentle verbal control, and 

E 4, Teacher choice of subject matter. 

In a general way, those four interactions with SES seem to have in common 
the implication that low SES pupils profit from greater amounts of task. struc- 
ture and an unobtrusive style of management of behavior, but that they are hin- 
dered in growth by teacher behavior which is more harsh and narrowly restrictive. 

Interactions with grade level indicated that greater gains for lower grade 
pupils were associated with greater amounts of: 

E 1, Gentle verbal control, and 

E 7, Closeness of teacher attention to nupi's. 

The latter finding modifies the interpretation of the negative relation 
between E 7 and vocabulary growth, showing that the negative relationship 
increases as grade level increases. 

Among the three nonlinear^ relations, E -i. Teacher choice of subject matter, 
appeared twice as n curve opening upward, which is uninteipretah le. E 5, Restric 
tive treatment of subject matter, appeared a<: an inverted U for spelling, indi- 
cated tnat an intenncuLate amount of the behavjijr was associated with greatest 
gain, ^ • 

Tlie results for relations between teacher derived competencies and pupil 
self-concept gain are :.hown in Table 3. Again, the pattern of linear relations 
for competencies emerges, this time with no signriicant complex relations. 
Four of the relationships are in the positive- direction all of which seem 
reasonable in relation to self-concept gain: 

C 1, Gathers and uses in formation relat i ng to individual differences among ^ 
students (two relations) , 
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C 8, Promotes self awareness- and positive self-conce^jts , ^.id 

C 6, Responds appropriately to pupil coping behavior. 

But the interpretive problem involves C 4, Assists students in using a variety 
of relevant communication techniques, which relates negatively to three of 
the self-concept measures. 

The relations between self-concept gain and the empirical-logical 
composites are shovm in Table 4. Again, the greater number of complex relations 
than linear ones is notable, ^fhe positive linear relationships included: 

E 5, Restrictive treatment of subject-matter (Teacher-School), and 

E 6, Pupil interest-attention (two measures). 

The relation with E S is particularly interesting, indicating that the pupil 
has positive feelings about himself in relation to teacher and school in a 
clearly structured environment in which the task is clear and there are no 
ambiguities. This partially parallels the finding of greatest spelling gain 
for intermediate amounts of the sajne behavior, agreeing that the least restric- 
tiveness does not appear to support either kind of growth. This result 
appears to^contrast with the expectations of open classrooms in which freedom 
and lack of structure are assumed to have their greatest returns in the non- 
cognitive areas. 

Composite E 2, Teacher control, general, related negatively^^to two of the 
self-concept measures, showing a partial parallel with its negative association" 
with achievement gain for low SES pupils. 

The interactions showed that greater gain for low SBS pupils was associated 
with smaller amounts of: 

E 2, Teacher control, general, and 

E 5, Harsh control (two relationships). 

Both of these measures interacted in the same way in the results for achievement. 
In addition, greater amounts of E S, Restrictive treatment of subject-matter, 
-were associated with greater gain for low SHS pupils. 

Two measures interacted with grade level: Greater amounts of E 7, 
Closeness of teacher attention to pupils, were associated with increased 
gain at the l.o.wer grade levels for two outcome measures, which parallels the 
results for achievement; and greater amounts of E 4, Teacher choice of 
subject matter, were associated with greater gain at the higher grade levels. 

Among the rxoalinear relations, E 4, Teacher choice of subject-matter 
appeared as curves opening upward for four measures, which also parallel the 
results for achievement, but are equally uninterpretable. Composite E 1, , 
Gentle verbal control , related in the form of an inverted U, indicating that 
intermediate amounts of this behavior were associated with greatest gain.. 



-7- 



Discussion 

There seem to be two primary, results from this study. One is the 
finding that the competencies often formed linear relations with the gain 
measures, but they were about as often contrary to expectations as in agree- 
-ment with them. The second major outcome of the study is the tendency of the 
competencies to form lin -.ir relations, but, in contrast, for the empirical- 
logical composites to fonr. complex relations with the pupil gain measures. 
A thought in relation to the few linear relations for the composites is 
that this study covers a wide range of grade levels, and linear relations "could 
be masked as aVconsequence . But if this were the case, most of the interactions 
would be expected to occur with grade level, but this is not the case. Most 
occur with SES. 



Still another possibility to consider is that the complex relatio^ns may 
be chance relations, entering the regression equations late. Bui: they? tend 
to enter in clusters, after the linear terms have been forced, often with F 
ratios in the teens, scattering through the 20^ s and into the 30*s. And 
parallels appear across analyses, so it is hard to dismiss them as chance 
occurrences. 

Both of these results are frankly perplexing. The clearest difference 
in the nature of the measures is that the competencies tend to have a greater 
variety of behaviors included in them, whereas the composites tend to be 
more narrowly focussed, but it is hard tb see why this should lead to the 
difference in results. 

^^^"^ .^^^^ ^^^^ there is little here to support the use of 
teacher derived competencies, but it is not c lear where-the problem lies-- 
whether it is in the basic ideas represented In the competencies (which is 
a troublesome thought since they are ideas which have wide acceptance in 
education) or whether the problem lies in the selection of behaviors from 
these two instruments to represent the competencies. A more fine-grained 
analysis, at the level of the behavioral, indicatcrs which were ])ooled, into 
competencies, might help to answer this question. 

An additional contrast is that for the teacher derived competencies there 
v.-as no parallel in the measures which were positively related with gain across 
achievement and self-concept, but for the composites there were parallels in 
the measures which were related with gain in a:diTe\/ement and solf-concept . 

Among the composites which showed parallels across the analyses of 
achievement and self- concept were interactions indicating lhat teacher controllini 
behaviors which were harsh and closely restrictive were a::sociated with 
decreased gain for low socioeconomic status pupils, and that closeness of 
teacher attention to pupils was more facilitative at the lower grade levels 
and/or less so at the higher grades. In general, these results for social status 
agree with earlier findings of Soar and Soar (1973), and Brophy and Everts on 
(1974), The finding that E 1, Gentle verbal control, was more facilitative 
for low SES pupils also agrees with earlier work (Soar § Soar, 1973), 
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It is not surprising to find instances of teacher behavi^:- which inter- 
acted with grade level, when the grades ranged from three through eight for 
achievement, and from four through twelve for self-concept. It' would be 
surprising if the same teacher behaviors in the same amounts were functional 
for pupils across such wide age ranges, but this is a question which has 
received very little empirical study. Neither is it surprising that SES 
interacts with teacher behaviors, but the number of such findings is surprising 

The most troublesome thought of all, in relation to the findings as a 
whole, is that competency based programs are being implemented widely across 
the nation on the basis of conceptions which are probably much like those 
which underlie the competencies studied here. Implicit in the use of these 
competencies is the assumption that they identify teacher behaviors which 
facilitate the intellectual and personal growth of pupils at all grade levels 
and at all SES levels. But the results of these analyses, at least, raise 
question about these procedures and the assumptions which underlie them. 

Equally distressing is the almost complete lack of support necessary 
either to evaluate programs whibh are being implemented at great cost, or to 
do the basic research necessary to identify the teacher behaviors which 
facilitate pupil growth and the circumstances under which they are functional. 

The possibility that great effort and cost may be committed to changing 
teacher behavior in ways which may be harmful to pupils is intolerable. 
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Table 1 

Relations Between Teacher Derived Competencies^ 
and Pupil Achievement Gain 



Achievejnent 
Measure 



Vocabulary 
Reading 

Spelling 

Ari thjTietic 
Concet>ts 



Linear 
Relations^ 



C9- 



C4-** 
C2+** 

C4-* 

C9+** 



Complex 
Relations 



C3XGR-** 
C1XGR+* 



Arithmetic 
Probleins 



C3-** 



a) CI. 



C3XGR-* 



**PA01 N=24 classrooms 



C2. 
C3. 
CA. 
CS. 



C7. 

C8, 
C9. 
b) See 



Gathers and uses information relating to individual differences mon^ 
students. 

Organizes pupils, resources, and materials for effective instruction. 

Demonstrates ability to communicate effectively with students. 

Assists students in using a variety of, relevant communication techniques, 

Assists students in dealing with their misconceptions or confusions, 
using relevant cues and techniques. 

Responds appropriately to coping behavior of students. 

Uses a variety of methods and materials to stimulate and promote 
pupil learning. 

Promotes self-awareness and positive self-concepts in students. 
Reacts with sensitivity to the needs and feelings of others, 
footnote. Table 3, for interpretation of table entries. 



Table 2 

Relations Between Empirical-Logical Composites^ 
and Pupil Achievement Gain 



Achievement 
Measure 



Vocabulary 

Reading 
Spelling 



Arithmetic 
Concepts 

Arithmetic 
Problems 



Linear 
Relations^ 



E7- 



E3- 



Complex 
Relations 



E7XGR-** 
E2XSES-* 

E42:f** 

E4XSES+** 



E4^+** 
E3XSES-** 
E1XSES+** 
E52^** 

E1XGR-* 



*P<.05 **P^,01 N=24 classrooms 

a) El. Gentle verbal control 
E2. Teacher control, general 

E3. Harsh control, T^P negative affect 

E4. T choice of subject matter 

ES. Restrictive treatment of subject-matter 

E6. Pupil interest-attention 

E7. Closeness of T attention to P 

E8, Small vs. large group activities 

b) See tfootnote. Table 3, for interpretation of table entries 



Table 3 

Relations Between Teacher Derived Competencies 
and Pupil Self -Concept Gain 



Achievement 
Measure 



Linear 
Relations^ 



Complex 
Relations 



Soar 
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Teacher- School 



Cl+^ 



Physical Appearance C4-** 

C8+** 



Interpersonal 
Adequacy 



C1+** 
C4-* 



Autonomy C6+** 
Academic Adequacy C4-** 



*P-^.05 **P^.01 N=40 class 



rooms 



a) The tables are interpreted as follows: . C9-* means that competency 9 

was negatively related, significant at the 5 percent level, C3XGR means 

that competency 3 interacted with grade level; the^pegative sign means that the 

combination of one high value and one low value for the two variables (high . 

C3 and low grade level, or the reverse) were associated with greater gain 

in the outcome measure. A positive sign means that high val.v.^s for both or 

low values for both were associated with greatest gain. £4^ means that 

Empirical -Logical Composite 4 showed a nonlinear relation with the outcome 

measure, with a + sign indicating that the curve opened upward, a - sign 

that it opened downward, ♦ 



Table 4 

Relations Between Empirical-Logical Composites 
and Pupil Self-Concept Cain 



Self -concept 
Measuiv*^ 



Teacher-School 
Physical Appearance 

Interpersonal Adequacy E2 



Autonomy 

Academic Adequacy 



Linear 


Complex 


Relations^ 


Relations 


c^ — 


E2XSES-* 




E5XSES+* 


E6+* 


E42+* 




E3XSES-** 




E5XSES+** 


E2-** 


E42+* 




E7XGR-** 




E3XSES-* 




E4XGR+* 




E5XSES+* 




El2-* 


E6-^** 


E42+* 




El^-** 




E7XGR-** 




£42+** 



*P<,05 **p<.01 N=40 classrooms 
a) See. footnote. Table 3, for interpretation of table entries. 



14 



